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2 MICROSCOPE FOR PERFORMING MULTIPLE FREQUENCY 

3 FLUOROMETRIC MEASUREMENTS 
4 

5 
6 
7 

8 TECHNICAL FIELD 

9 The present invention relates to the field of fluorometric and phosphorescence 
10 measurement using light modulated in intensity with a plurality of frequencies. 
11 

12 BACKGROUND 

13 The characteristics of light emanating from an object or a sample may be 

14 advantageously detected in order to determine characteristics of the emission 
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1 source. For many years, spectrographic techniques have been used to perform 

2 analysis of materials ranging from human blood and other biological materials to 

3 slag from a crucible. For example, it has been known that wavelengths of light 

4 absorbed by a material, as well as the wavelengths of light emitted by a material 

5 during an excited state, such as combustion, both indicate the composition of the 

6 material. Today, analytic instruments in industrial, scientific and medical 

7 applications make widespread use of such emission spectra and absorption spectra. 

8 Other techniques for exciting molecules to emit light include formation of a plasma. 

9 Causing light to fall upon a material to be analyzed may also be used to stimulate 

10 emission of light for spectrographic analysis. Such techniques include Raman 

11 spectroscopy, where, for example, the output of a mercury vapor arc may be filtered 

12 and used to excite a transparent sample. As the light passes to the sample, it is 

13 scattered and undergoes a change in wavelength and a random alteration in phase 

14 due to changes in rotational or vibrational energy of the scattering molecules. 

15 Raman scattering is a principal analytic tool in industry and science today. 
16 

17 Another class of analytic instruments uses fluorescence measurements to identify 

18 materials. In such systems, an excitation source, such as a laser, is used to excite 

19 atoms or molecules, raising electrons into higher energy states. When the electrons 

20 revert back to the unexcited state, they fluoresce or emit photons of light 

21 characteristic of the excited atom or molecule. The wavelength of the emitted light 

22 thus contains information respecting the identity of the excited atom or molecule. In 

23 addition, the delay between the exciting light and the emitted light, as well as the 

24 amplitude of the emitted light, both give information respecting the excited atom or 

25 molecule. 
26 

27 While one may visualize an excitation pulse of light being pumped into a sample 

28 and the emission spectra measured and analyzed over time, in practice, such 

29 measurements are achieved by causing a light source from an excitation source 
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1 modulated with a radio frequency periodic signal to excite a sample. In particular, a 

2 pulsed dye laser, or a continuous wave laser whose output is modulated by a 

3 Pockels cell, may be used to excite a sample to fluoresce. In such systems, the 

4 modulated laser excitation source is caused to fall on the sample. The modulated 

5 laser excitation source comprises a pencil of light modulated in intensity at the laser 

6 intensity modulation frequency. After a very short period of time, the system 

7 reaches the steady-state. During the steady-state, a steady-state fluorescence 

8 emission occurs. This steady-state fluorescence emission may be measured to 

9 determine the phase and modulation of the emission as compared to the excitation. 
10 

11 BRIEF SUMMARY OF THE INVENTION 

12 By "phase" is meant the delay, for example, in degrees, of the steady-state 

13 modulated fluorescence emission signal as compared to the modulated laser 

14 excitation source. By "modulation", sometimes also referred to as the modulation 

15 ratio, is meant the ratio of the amplitude of a fixed reference sample portion of the 

16 modulated laser excitation source to the amplitude of the steady-state fluorescence 

17 emission. 
18 

19 In practice, modulation may be measured by comparing the amplitude of the 

20 steady-state fluorescence emission (the measurement signal) to the amplitude of a 

21 fixed portion of the modulated laser excitation source, (the reference signal) This 

22 fixed portion of the modulated laser excitation source may be extracted from the 

23 excitation source using a partially silvered mirror. In addition, phase may also be 

24 obtained by detecting and measuring the phase of the envelope of the steady-state 

25 fluorescence emission as compared to the reference signal. 
26 

27 Conventionally, as is illustrated, for example, in U.S. Patent No. 4,937,457 to 

28 Mitchell, this is done by causing the steady-state fluorescence emission to fall upon a 

29 photomultiplier tube which has one of its dynodes driven by a heterodyne oscillator 
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1 whose heterodyne signal output frequency differs from the frequency of the periodic 

2 signal by a relatively small difference frequency (for example, less than 500 Hz). The 

3 result, in the steady-state, is that the photomultiplier acts as a mixer, effectively 

4 multiplying the heterodyne signal by the steady-state fluorescence emission and 

5 generating a modulation product at the relatively small difference frequency. The 

6 amplitude and phase of the modulation product, which functions as a measurement 

7 signal, may then be used to determine the desired modulation and phase 

8 information. 
9 

10 In order to determine the amplitude and phase of the modulation product, it is 

11 necessary to measure the same against a reference. A fixed portion of the modulated 

12 laser excitation source may be used as a reference. In particular, the fixed portion of 

13 the modulated laser excitation source, which was extracted from the excitation 

14 source using a partially silvered mirror, is sent to a second photomultiplier tube. 

15 The second photomultiplier tube also has one of its dynodes driven by the same 

16 heterodyne oscillator. Accordingly, the second photomultiplier tube also acts as a 

17 mixer and outputs a reference modulation product at the same relatively small 

18 difference frequency. The amplitude and phase of the reference modulation product 

19 may then be used as a standard to determine the relative modulation and phase of 

20 the measurement signal. 
21 

22 Extraction of modulation and phase information may be done digitally. 
23 

24 A further refinement in the measurement technique is to perform the above 

25 measurement of modulation and phase on a sample many times using different 

26 modulation frequencies each time. Generally, this will result in the generation of a 

27 first characteristic for phase as a function of modulating frequency and a second 

28 characteristic for modulation which may also be plotted against frequency. 

29 Generally, phase angle will increase for increasing laser intensity modulation 
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1 frequency. Moreover, for samples exhibiting longer lifetimes, phase differences will 

2 be larger at a given frequency of modulation. 

3 

4 Similarly, modulation tends to decrease in amplitude with increasing laser intensity 

5 modulation frequency. 
6 

7 Moreover, for samples exhibiting longer lifetimes, modulation tends to a lower 

8 value. This is so because the statistical probability of emission of a longer-lived state 

9 is spread over a longer period of time. 

10 If curve fitting techniques are used to match the plot of frequency versus phase and 

11 the plot of frequency versus modulation, to a pair of equations, analysis of the 

12 equations can be used to discern multiple individual fluorescing components, for 

13 example organic molecules, fluorescing semiconductor depositions or dopants or the 

14 like, in a sample. Curve fitting techniques are known in the field today and 

15 generally involve the use of a digital computer to perform the desired curve fitting 

16 and the comparison of various physical models that represent the molecular system 

17 and its environment. 
18 

19 Presently, it is possible to measure such features as rotation of molecules of a sample 

20 using polarized light, electrical fields, or the like. For example, if a molecule is 

21 rotating in a liquid, on account of Brownian motion or other influence, binding of an 

22 agent to a molecule will make the molecule heavier and may also affect its viscous 

23 resistance. This would translate into changes in rotation rate as a result of changes 

24 in the molecular size, shape and hydrodynamic volume. 

25 In accordance with the invention, it has been recognized that the identification of 

26 multiple components in certain types of samples can be facilitated through the 

27 association of spatial data with optical readings. This may be achieved through the 

28 use of a fluorescence detector having a plurality of elements. In accordance with the 

29 invention, different points on a sample produce fluorescence emissions which are 



-5- 



1 measured by separate fluorescence detector elements. Accordingly, it is possible to 

2 measure a particular effect with respect to different parts of the sample. 
3 

4 More particularly, in accordance with the invention, a light source, such as a laser 

5 source, is used to excite a sample into the fluorescent state. Light from the excited 

6 sample is collected by a microscope. The microscope utilizes conventional confocal 

7 optics optimized to have a very narrow depth of field, thus limiting the information 

8 collected to a thin planar region. 
9 

10 It will be understood to those of skill in the art that a microscope is only one way to 

11 get image (spatial) data. The inventive system may be employed in connection with 

12 any suitable image generation system. 

13 In accordance with the invention, an image in two dimensions of this planar region 

14 is focused on the sensitive input face of an image intensifier. The image intensifies 

15 at its output, presents an amplified optical image of the thin planar region. This 

16 amplified optical image then drives, for example, two dimensional array detector 

17 such as CCD (charge-coupled device), CMOS array, or other array detectors. 
18 

19 The CCD array detector outputs a two-dimensional matrix of information 

20 respecting the fluorescence characteristics of the various parts of the sample. In 

21 accordance with the invention it is contemplated that various excitation wavelengths 

22 will be used to cause fluorescence, and that various types of filters may be used in 

23 connection with the output fluorescence information. For example, a band reject 

24 filter may be used to eliminate the excitation wavelengths. A high pass, low pass or 

25 bandpass optical filter may also be used to reduce noise by passing fluorescence 

26 wavelengths of interest. 
27 

28 If the sample is a slide supporting a sample of biological material, such as a plurality 

29 of cells in a liquid medium, as detailed below, depending upon magnification and 
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1 other parameters, the matrix of information comprises a picture of the fluorescence 

2 characteristics of various parts of the cell. 

3 

4 For example, if a mammary gland cell is in being imaged, and the cell is being 

5 treated with a drug, the matrix of information may show that the drug is entering 

6 the cell through the cell membrane at a particular rate. Likewise, after a time the 

7 matrix of information may reflect absorption of the drug by the Golgi apparatus but 

8 not in the rough endoplasmic reticulum. Such features may be geographically 

9 illustrated or numerically analyzed. 

10 

11 Likewise, if the drug is undergoing molecular bonding (as opposed to just being 

12 present) in a particular region of the cell, this may be measurable by fluorescence 

13 measurements with appropriate sources and filters. 
14 

15 In accordance with the present invention, it is contemplated that fluorescence 

16 information can be graphically displayed. For example, depending upon amplitude, 

17 each part of the image may be color-coded for intensity, for example on a scale 

18 wherein violet is indicative of the highest energy level, blue is indicative of the next 

19 highest energy level, green indicative of a still lower energy level and so forth 

20 through the spectrum to the color red which is indicative of the lowest energy level. 
21 

22 It is important to note that, the information obtainable is not limited to amplitudes 

23 but also the lifetime of desired parameters in model space, which can be graphically 

24 displayed as two-dimensional or three-dimensional data . Such an energy level 

25 display may be useful standing alone. However, the display may have 

26 superimposed on the energy level display a graphical indication of the parts of the 

27 image. Such a graphical indication may be generated by simple image display or 

28 may be enhanced using artificial intelligence or other computer techniques, such as 

29 boundary detection and other well-known imaging techniques. Such information 
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1 can be sent to an imaging device and the imaging information superimposed on the 

2 matrix of information. 

3 



4 Using such techniques, and computer implemented pattern analysis techniques, 

5 rotation may be measured. Moreover, because such measurement is based on image 

6 data, such rotation information can be generated in greater detail than that 

7 obtainable using conventional techniques. 
8 

9 BRIEF DESCRIPTION OF THE DRAWINGS 

10 The advantages, and the method and apparatus of the present invention will be 

11 understood from the following description taken together with the drawings, in 

12 which: 

13 Figure 1 is a block diagram of a system for implementing the method of 

14 the present invention ; 

15 Figure 2 is a detail showing a sample under observation by the inventive 

16 system; 

17 Figure 3 illustrates a fluorescent image; 

18 Figure 4 illustrates an intensified fluorescence lifetime spatially resolved 

19 fluorescent image resulting in the ability to gather spatial and 

20 multi-frequency data simultaneously; 

21 Figure 5 illustrates an output from the inventive system together with 

22 various modulation and phase characteristics for pixels of an 

23 image which result in a particular value determination for 

24 fluorescence; 

25 Figure 6 is an alternative embodiment of a system for implementing the 

26 method of the present invention; and 

27 Figure 7 is an alternative embodiment of an optical arrangement useful 

28 in, for example, the systems for implementing the method of the 

29 present invention illustrated in Figures 1 and 6. 
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1 DETAILED DESCRIPTION OF THE BEST MODE OF THE INVENTION 

2 Referring to Figure 1, a fluorescence microscope system 10„ illustrative of an 

3 example of an inventive luminescence image generating system, constructed in 

4 accordance with the present invention is illustrated. In particular, a slide 12 

5 comprises a glass slide base 14 and a glass cover 16. Sample 18, which may be 

6 liquid, or a solid or dry material, is positioned between glass slide base 14 and glass 

7 cover 16. 
8 

9 Sample 18 is illuminated by a source of light such as laser 20, which outputs a pencil 

10 beam 22 of light which falls on sample 18 as illustrated in Figure 2. Beam 22 passes 

11 through a half-silvered mirror 24. Half- silvered mirror 24 has the characteristic of 

12 reflecting only a very small portion of beam 22. In accordance with the preferred 

13 embodiment of the invention, half-silvered mirror 24 reflects only as much of beam 

14 22 as is necessary to generate a clear signal for use as a reference beam 26, as will be 

15 described below. Depending upon the nature of the reference signal detector optics 

16 and detector electronics, half-silvered mirror 22 may reflect as little as two or three 

17 percent of beam 22. It is desirable to minimize the percentage of beam 22 which is 

18 diverted away from sample 18 to form reference beam 26, in order that the 

19 maximum amount of energy from beam 22 falls on sample 18 and, accordingly, the 

20 maximum amount of fluorescence radiation is produced for detection by the system. 
21 

22 As noted above, the inventive system relies upon the demodulation of a modulated 

23 fluorescence signal stimulated by a modulated excitation light source. The same is 

24 achieved through the use of a fundamental oscillator 28 operating at the desired 

25 modulation frequency, typically in the range of 5 MHz. The output of fundamental 

26 oscillator 28 is sent to a frequency synthesizer 30 which synchronizes itself with the 

27 output of fundamental oscillator 28 and generates a plurality of other frequencies. 

28 In accordance with the preferred embodiment of the invention, fundamental 

29 oscillator 28 will output a signal at 5 MHz and at multiples of 5 MHz ranging as 
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1 high as 300 MHz or higher. In accordance of the present invention, however, it is 

2 contemplated that the frequencies output by frequency synthesizer 30 may have 

3 other values, as may be convenient and/ or efficient to generate, and/ or process as 

4 described below, provided that the desired range of modulation frequencies is 

5 covered with enough data points to perform a least squares curve fitting operation 

6 upon the data points within a desired statistical confidence interval. 
7 

8 In particular, in accordance with the invention, the method of least squares is used 

9 to fit a curve as close as possible to experimental data points produced by the system 

10 by minimizing the sum of the squares of the deviations of the experimental data 

11 points from the curve. In the case where the derivation of curve describing the 

12 mathematical relationship between frequency and either modulation or phase, the 

13 functional type (linear, quadratic, exponential, some of two exponentials, etc.,) is 

14 known, the method of least squares is used to determine the parameters of a general 

15 equation of that category. Other statistical methods may also be used. In addition 

16 to estimating the parameters of the equation, the system may also be used to 

17 calculate standard error and a confidence interval. In addition, the inventive system 

18 10 may be used even where there is no particular functional type that can be 

19 postulated as a starting point for the calculation. In such a case, standard fitting 

20 procedures may be used to gain insight into the subject matter under study. In 

21 addition, qualitative information respecting physical processes, for example as they 

22 vary over time, may be more easily understood after performance of a method of 

23 least squares approximation. 
24 

25 The shape and duration of the electrical pulses output by frequency synthesizer 30 

26 may be adjusted by waveshaper 32, which operates by conventional means. 

27 Waveshaper 32 is driven by frequency synthesizer 30. In accordance with the 

28 invention, the output of waveshaper 32 is adjusted to be the sum of pulses of 

29 electrical energy at the fundamental and other frequency synthesizer frequencies. 
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1 The pulses of energy at the fundamental frequency comprise a first laser drive 

2 signal. The pulses of energy at the next highest frequency comprise a second laser 

3 drive signal. The pulses of electrical energy at the third highest frequency comprise a 

4 third laser drive signal, and so on through the range of frequencies output by 

5 frequency synthesizer 30. 
6 

7 The output of waveshaper 32 is sent to laser 20 which emits laser energy with a 

8 desired optical wavelength, but modulated in intensity by the output of waveshaper 

9 32, which constitutes the summed pulses at the various frequencies generated by 
10 frequency synthesizer 30. 

11 

12 In accordance with the preferred embodiment of the invention, it is contemplated 

13 that the output of frequency synthesizer 30 will take the form of a plurality of 

14 electrical output signals. Each of these electrical output signals is individually 

15 shaped. All of the electrical output signals are summed to achieve the desired drive 

16 signal for laser 20. 
17 

18 A heterodyne frequency synthesizer 34 is synchronized to the output of 

19 fundamental oscillator 28 and outputs a plurality of heterodyne signals. There is a 

20 heterodyne signal associated with each of the output signals generated by frequency 

21 synthesizer 30. The frequency of each of these heterodyne signals is slightly 

22 different from the frequency of its associated laser drive signal. The construction of 

23 heterodyne frequency synthesizer 34 is conventional and similar to that of frequency 

24 synthesizer 30. 
25 

26 This difference in modulating frequencies must be different for each associated laser 

27 drive signal and its respective heterodyne signal, so that digital filters may 

28 individually separate modulation products for each of the laser drive signals at their 

29 respective frequencies. Thus, the first pair may comprise an output signal at 5MHz 
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1 and an associated heterdyne signal at 5.000005 MHz. The second pair would be 

2 10MHz and 10,000010 Mhz, and so forth. 

3 

4 This difference may be, for example, 5 Hz for the first laser drive signal, 10 Hz for 

5 the second laser drive signal, 15 Hz for the third laser drive signal, and so forth. The 

6 various heterodyne frequency signals are then coupled to a heterodyne waveshaper 

7 36 which forms output pulses having a desired shape, duration and delay. 
8 

9 In accordance of the preferred embodiment of the invention, the shape of the output 

10 from heterodyne waveshaper 36 comprises the sum of the various heterodyne 

11 frequency signals. 
12 

13 It is noted that, in accordance in the invention, a single frequency synthesizer may 

14 perform the combined function of frequency synthesizer 30 and heterodyne 

15 frequency synthesizer 34. Likewise a plurality of appropriate waveshaping circuits, 

16 each coupled to one of the outputs of the waveshaping circuits, may be used to 

17 synthesize the desired waveforms. 
18 

19 The output of the heterodyne waveshaper 36 is coupled to a sample image 

20 intensifier tube 38. The output of heterodyne waveshaper 36 is coupled to the 

21 reference image intensifier tube 40. 
22 

23 As described above, light beam 22 illuminates a sample 18 which may include, for 

24 example, a cell 42. As illustrated in Figure 2, cell 42 includes a membrane 44 and a 

25 nucleus 46. Cell 42 is contained in a liquid medium between slide base 14 and slide 

26 cover 16. When sample 18 is illuminated by light 22 from laser 20, the molecules 

27 comprising the cell are excited and fluoresce, emitting fluorescent radiation 48. 

28 Fluorescent radiation 48 is lower in energy than excitation source light 22, and, 

29 accordingly, it is of longer wavelength. In addition, a portion of light 22 may be 
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1 reflected in various directions as light 50. Light 50, because it is simply reflected 

2 light, has the same wavelength as the excitation source light 22. A portion of both 

3 fluorescent radiation 48 and reflected excitation source light 50 travels along a path 

4 52 (Figure 1) toward microscope focusing optics 54, shown diagrammatically as a 

5 simple convex lens. In practice, microscope focusing optics 54 comprises a plurality 

6 of lenses in a confocal configuration, and including a number of masks to achieve 

7 the desired confocal characteristic. In particular, the desired confocal characteristic 

8 achieves focusing of objects in a narrow range of focus which consists of a planar 

9 volume 56 of relatively shallow depth 58, as illustrated in Figure 2. The object of the 

10 use of the inventive fluorescence microscope system 10 is to view a cross-section of 

11 the object, such as cell 42 under view. 
12 

13 Microscope focusing optics 54 focuses both fluorescent radiation 48 and reflected 

14 excitation light 50 on the sensitive face 60 of image intensifier tube 38. During the 

15 normal operation of image intensifier tube 38, the optical image stimulates the 

16 formation of an electron image which is accelerated and triggers an avalanche to 

17 form an amplified image on the output face 61 of image intensifier tube 38. If 

18 desired, because of the relatively low level of fluorescent radiation 48 from a 

19 particular sample, reflected excitation light 50 may be blocked by a band-reject filter 

20 62. 
21 

22 As discussed above, fluorescent radiation 48 has an amplitude and phase 

23 characteristic which varies from that of the excitation light 22 produced by laser 20. 

24 However, in order to measure this difference, a sample of the excitation light 22 

25 reflected by half-silvered mirror 24 as sample light 26 must be measured. 

26 Accordingly, fluorescent radiation 48 is brought by focusing optics 64 onto the 

27 sensitive face 66 of image intensifier tube 40. The image brought to sensitive face 66 

28 is accelerated and amplified to form an image on the output face 68 of image 

29 intensifier .tube 40. 
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1 It is necessary for the two amplified images on output faces 61 and 68 to be 

2 compared in order to determine modulation and phase information. This is done by 

3 providing output face 61 with a CCD detector 70, for example a 250 element by 250 

4 element CCD or other suitable detector, preferably with a size and resolution 

5 matched to the output of image intensifier tube 38. The output of CCD 70 is thus an 

6 image of that portion of the sample focused by focusing optics 54 on sensitive face 

7 60. 
8 

9 In similar fashion, output face 68 of image intensifier tube 40 is provided with a 

10 CCD detector 72, substantially identical to CCD 70. The output of CCD 72 is thus an 

11 image of that portion of the reference light traveling along path 26 and focused by 

12 focusing optics 64 on sensitive face 66 and serves as a reference with respect to 

13 which the sample image data may be compared to generate image information. 

14 

15 The outputs of image intensifier tubes 38 and 40 are sent to a computer interface 

16 board 74 plugged into a computer 76. Using conventional filtering techniques, 

17 interface board 74 and computer 76 (controlled by filter software 78) together 

18 separate out the amplitude and phase information for both the reference beam 26 

19 and fluorescent radiation 48, and generate amplitude (modulation) and phase 

20 information for the fluorescent light emitted by sample 18. In addition, because this 

21 information is associated with two-dimensional spatial data in a given plane of 

22 focus, the fluorescence characteristic may be graphically shown on an output device 

23 80 for visual or intuitive analysis and/ or numerically processed with any desired 

24 criteria to achieve any desired quantitative outputs. 
25 

26 Before using the inventive system to perform a measurement on a sample, it is 

27 necessary to calibrate the system. This is done by first using, in place of a sample, a 

28 standard consisting of a zero lifetime scattering solution. When the instrument 

29 measures the zero lifetime scattering solution, it creates a set of normalizing phase 
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1 and modulation standard values which function as a standard. These normalized 

2 phase and modulation values, obtained using the zero lifetime scattering solution 

3 standard, are compared to measured phase and modulation values created by the 

4 system when it measures the sample. The system generates the phase and 

5 modulation standard values in the same way in which it measures phase and 

6 modulation values for a sample, as will be described in detail below. The actual 

7 phase and modulation value for a particular point on the sample is the difference, 

8 respectively, between the phase and modulation values generated for the point on 

9 the sample and the phase and modulation value generated for the same point using 
10 the zero lifetime scattering solution standard. 

11 

12 During operation of the inventive system to measure the characteristics of a sample, 

13 laser 20 is excited to produce modulated laser light. A small portion of the 

14 modulated laser light is reflected by half-silvered mirror 24. This reflected light takes 

15 the form of light 26 which is sent through optics 64 to sensitive face 66 of image 

16 intensifier tube 40. CCD 72 then forms a reference modulated electrical signal. In 

17 the instant example of a 250 by 250 element image intensifier tube 40 driving a 250 

18 by 250 element CCD 72, this reference modulated electrical signal takes the form of 

19 62,500 individual reference signals, one corresponding to each element in CCD 72. 

20 All of these 62,500 individual signals each serve as a reference signal and are 

21 downloaded in a conventional manner and sent to computer 26 via interface board 

22 74. 
23 

24 The bulk of the radiation produced by laser 20 passes through half-silvered mirror 

25 24 and falls on sample 18, causing it to fluoresce with an amplitude and phase 

26 different from the modulated (or pulsed) laser output of laser 20. Fluorescence 

27 emissions 48 from sample 18 then pass through optics 54 and are imaged on 

28 sensitive face 60 of image intensifier tube 38. Band reject filter 62 may have the 

29 characteristic of reflecting light at the output wavelength of laser 20. Accordingly, 
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1 band reject filter 62 passes fluorescence emissions while blocking transmission of 

2 reflected light at the wavelength of laser 20 and preventing it from overloading 

3 image intensifier tube 38. Alternatively other filters, such as high pass filters, low 

4 pass filters or bandpass filters may be used, and, depending upon the particular 

5 measurement being performed, any one or more of these filters may provide a most 

6 nearly optimum characteristic for the detection of the fluorescence wavelengths of 

7 interest while at the same time minimizing the interference of noise in the inventive 

8 system. 
9 

10 This fluorescent light takes the form of fluorescent light 48, emitted by sample 18 

11 when it fluoresces, and is focused as an image 82 (Figure 3) by optics 54 onto 

12 sensitive face 60 of image intensifier tube 38. It is noted that in the figures, the 

13 illustrated number of elements of image intensifier tube 38 and CCD 70 is greatly 

14 reduced for purposes of clarity of illustration. Image 82 is accelerated and 

15 intensified by image intensifier tube 38 to form an intensified lifetime based 

16 fluorescence image 84, as illustrated in Figure 4. 
17 

18 Intensified image 84 then falls on the front face 86 of CCD 70. CCD 70 then forms a 

19 measurement modulated electrical signal. In the instant example of a 250 by 250 

20 element image intensifier tube 38 driving a 250 by 250 element CCD 70, this 

21 reference modulated electrical signal takes the form of 62,500 individual 

22 measurement signals, one corresponding to each element in CCD 70. Each of the 

23 62,500 individual measurement signals is associated with one of the 62,500 

24 individual reference signals output from CCD 72. These 62,500 individual signals 

25 each serve as a reference signal and are downloaded in a conventional manner and 

26 sent to computer 26 via an interface board 74. 
27 

28 In accordance with the preferred embodiment of the invention, each one of the 

29 62,500 individual multif requency measurement signals (for example, each 
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1 containing a hundred single frequency signals, corresponding to a hundred 

2 excitation frequency modulation components associated with each pixel 88) is 

3 compared to its respective one of the 62,500 individual reference signals to generate 

4 phase and modulation information for the point on the image associated with the 

5 particular individual measurement signal and the point on sample 18 measured by 

6 the respective individual measurement signal. This is done by filtering the output of 

7 each pixel 88 to separate out the difference frequency modulation products (one 

8 hundred is the example of fifty modulation frequencies). 

9 Thus, each pixel 88 generates a plurality of phase measurements 90, one for each of 

10 the excitation frequencies, as is illustrated in Figure 5. In addition, each pixel 88 

11 generates a plurality of modulation measurements 92 for these frequencies . This 

12 may be better understood when it is recognized that image intensifiers 38 and 40 act 

13 as mixers, mixing each of the heterodyne signals and its respective measurement 

14 signal 
15 

16 Each one of the comparisons of respective measurement and reference signals for a 

17 particular point on sample 18 is performed individually for each of the modulation 

18 frequencies output by frequency synthesizer 30 to generate a pair of data points 92 

19 (fifty in each pixel) In particular, there are modulation data points 92 (fifty for each 

20 pixel) and phase data points 90 (fifty for each pixel) for each of the fifty frequencies 

21 which is modulating the output of laser 20, as is illustrated in Figure 5. Thus, as in 

22 the example above, if there are fifty different modulation frequencies used to 

23 modulate laser 20, each data measurement results in the generation of fifty 

24 modulation and fifty phase data points for each of the 62,500 individual 

25 measurement signals, or 6,250,000 data points for each interval of time over which a 

26 measurement is taken. Again, for purposes of illustration, the number of data points 

27 90 and 92 illustrated in Figure 5 has been reduced for purposes of clarity of 

28 illustration. 
29 
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1 Generally, the duration of the interval over which the measurement is taken 

2 depends upon the intensity of the fluorescence information and the signal-to-noise 

3 ratio. Generally, as is known in the art, with high signal-to-noise ratios and 

4 fluorescent emission intensity, shorter intervals are sufficient to collect enough 

5 photons to achieve a good data point measurement. 
6 

7 Accordingly, intensified image 84 is turned into a plurality of modulation 

8 characteristic curves 94-94f and phase characteristic curves 96-96f . Each pixel 

9 receives a different excitation input and, accordingly, depending upon intensity and 

10 delay (that is modulation and phase), a plurality of modulation characteristics, for 

11 example, modulation characteristic curves 94, 94a, 94b, 94c, 94d, 94e, and 94f may be 

12 derived by computer 76. Likewise, a plurality of phase characteristics, for example, 

13 phase characteristic curves 96, 96a, 96b, 96c, 96d, 96e, and 96f, respectively, are also 

14 generated by computer 76. These phase and modulation characteristic curves 

15 correspond, respectively, to pixels 88, 88a, 88b, 88c, 88d, 88e, and 88f, and are 

16 illustrative of the calculations for the entire display. 
17 

18 For purposes of illustration, Figure 5 is simplified to show a display 98 which shows 

19 calculation details for only a limited number of pixels and only seven different 

20 fluorescent lifetimes, with the shortest lifetime reflected by phase characteristic 

21 curve 96 and modulation characteristic curve 94. Characteristic curves 94a and 96a 

22 correspond to the next longest lifetime, of those illustrated. Characteristic curves 

23 94b and 96b, 94c and 96c, 94d and 96d, 94e and 96e, and 94f and 96f, respectively, 

24 represent experimental data points for increasingly longer lifetimes. 
25 

26 If desired, display 98 may be color-coded or coded in shades of gray or otherwise, as 

27 illustrated in Figure 5 to show different lifetimes with different graphical 

28 representations. These lifetimes may correspond to differences in physical 

29 characteristics. For example, in the image of cell 42, the cell wall tends to have a 
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1 lifetime which may be derived from curves 94c and 96c and accordingly the display 

2 98 includes a corresponding pixel 88c of identifiable characteristic appearance on 

3 display 98. Likewise, most of the edge of the nucleus is defined by pixels with the 

4 same measured lifetime as pixel 88f and is illustrated with a second characteristic 

5 appearance. 
6 

7 As may be understood from the above discussion, the inventive system results in a 

8 relatively high need for computing power. However it is unnecessary that all of this 

9 computing power be concentrated in the general purpose, and thus more expensive, 

10 mainframe of computer 76, which may be a personal computer, or a more powerful 

11 system. In particular, the number of data points and the speed with which the same 

12 may be generated and processed for a given amount of computing power may be 

13 maximized by providing interface board 74 with storage and/ or calculation 

14 functions in order to reduce the computational load on the accumulator of 

15 computer 76. The result is a significant increase in speed and/ or data density. 
16 

17 Computer 76 then processes the measurement data points in a conventional manner, 

18 for example, using them to identify particular components and concentrations of 

19 those components. 
20 

21 While this system has been illustrated showing a cell, semiconductor or other type of 

22 system may also be imaged and measured. 
23 

24 A second embodiment of the invention is illustrated in Figure 6. In this 

25 embodiment, corresponding or analogous parts are numbered with numerals 100 

26 higher than their corresponding parts in the Figure 1 embodiment for purposes of 

27 succinct description in this specification. In particular, it is noted that the inventive 

28 system 110 illustrated in Figure 6 is substantially identical to the system illustrated 

29 in Figure 1, except for the introduction of a half-silvered mirror 197 which reflects 
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1 about 5 percent of the radiation to an optical microscope 199, which may be viewed 

2 by the human eye, used to make a photographic exposure, or any other desired 

3 output. This is of particular value if a relatively low power computer is used, or a 

4 great number of data points are being acquired, as real-time adjustment of the 

5 system can be done initially using microscope 199. Alternatively, it is noted that 

6 half-silvered mirror 197 may be made completely reflective, provided that it is 

7 provided with a mounting which slides it into optical path 152, when it is being 

8 used, and removes it completely from path 152, when its use is not needed. 
9 

10 A particularly advantageous optical arrangement for an optical system to be 

11 employed, for example in either the system of Figure 1 or the system of Figure 6, is 

12 illustrated in Figure 7. In this embodiment, system elements corresponding to the 

13 elements of Figure 1 are numbered 200 higher and perform substantially the same 

14 function, except that light from source 220 is reflected by half-silvered mirror 224 

15 onto sample 218, and fluorescence radiation is passed by mirror 224 to collection 

16 optics 254 and the detector which it images. This arrangement has the advantage of 

17 maximizing the fluorescence signal compared to other light in the system, on 

18 account of the angular relationship between the optical members, excitation source 

19 and sample. 
20 

21 While illustrative embodiments of the invention have been described, it is 

22 understood that various modifications may be obvious to those of ordinary skill in 

23 the art. Such modifications are within the spirit and scope of the invention, which is 

24 limited and defined only by the appended claims. 
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